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ABSTRACT 

Researchers in distance education are interested in observing and modeling learners' 
personality profiles, and adapting their learning experiences accordingly. When learners 
read and interact with their reading materials, they do unselfconscious activities like 
annotation which may be key feature of their personalities. Annotation activity requires the 
reader to be active, to think critically, to analyze what has been written, and to make 
specific annotations in the margins of the text. These traces are reflected through 
underlining, highlighting, scribbling comments, summarizing, asking questions, expressing 
confusion or ambiguity, and evaluating the content of reading. In this study, we present a 
new approach to build learners' personality profiles based on their annotation traces 
yielded during active reading sessions. To validate our approach, we invited 100 volunteers 
ranging in age from 22 to 50 years old. The participators were instructed to utilize our 
system to achieve their reading and annotation activities. We apply the paired t-test to 
evaluate the system's efficiency to measure user's human traits versus the scores of his 
personality traits measured using the Neo-IPIP inventory. The experimental results show 
the system performance to measure, with reasonable accuracy, the scores of learner's 
personality traits. 

Keywords: Annotations, learner's personality traits, personality computing, learning 
personalization, learner modeling. 

INTRODUCTION 

"It's evident for anyone who has taught a course that students are not a homogeneous 
group. They come into courses with major individual differences among their level of 
knowledge about subject matter content, their intellectual and meta-cognitive skills, their 
beliefs and attitudes toward the topic and toward learning" (Ambrose & Lovett, 2014, p. 7) 
as well as their human personality characteristics. For such reasons, some students in some 
classrooms might learn more than students in the same or another classroom. Thus, it's 
necessary to adapt teaching activities to different student characteristics. 


46 



Personality traits are one of the student's individual characteristics which extensively 
interest educational experts. Several works have shown the significant correlation of 
learners' personality characteristics to diverse learning parameters (academic 
performance, learning achievement, learning motivation, online course impressions, 
learning styles, learning approaches, etc.) which demonstrates the necessity to learn about 
students' personality to support them efficiently during their learning activities (Ariani, 
2013; Jensen, 2015; Chue, 2015; Zhou, 2015; Xie, & Zhang, 2015; Al-Naggar, Osman, 
Ismail, Bobryshev, Ali, & Menendez-Gonzalez, 2015; Zhou, & Intaraprasert, 2015; Ghazi, 
Shahzada, & Ullah, 2013; Ibrahimoglu, Unaldi, Samancioglu, & Baglib el, 2013; Harley, 
Carter, Papaionnou, Bouchet, Landis, Azevedo, & Karabachian, 2016; Komarraju, Karau, 
Schmeck, & Avdic, 2011; Pornsakulvanich etal., 2012; Sahinidis, Frangos, &Fragkos, 2013; 
Shahri, Javadi, & Esmael, 2012). These scholars, as well as, others show how important to 
change the traditional "one-size-fits-all" educational system to respond to learner's 
individual characteristics and needs. Actually, students cannot be educated with the same 
pacing, resources, and instructional pedagogy due to their diversity. 

For instance, (Al-Dujaily, Kim, & Ryu, 2013) show the impact of personality traits 
(introversion vs. extroversion) on learners' motivation and ability to learn with adaptive e- 
learning system. Such empirical works constitute theoretical basis for applications tending 
to develop classrooms that are student-centered (El Bachari, Abdelwahed, & El Adnani, 
2010; Fatahi, Kazemifard, & Ghasem-Aghaee, 2009; Fatahi, Moradi, & Kashani-Vahid, 2016; 
Faria, Almeida, Martins, Gonsalves, & Figueiredo, 2015). 

Researchers in education emphasize the importance to consider learners' personality 
differences in teaching which can lead consequently to student's positive academic 
outcomes (Ambrose & Lovett, 2014; Seifert & Sutton, 2009). 

In the digital era, organizations and institutions are increasingly moving toward adopting 
distance learning. Several works show the students' positive attitudes and views towards 
distance education (Gurbuz, 2014; Sad, Goktas, & Bayrak, 2014; Stanley, 2015; Chong, 
Francis, Cooper, Abdullah, Hmwe, & Sohod, 2016). The online method of learning uses the 
web as the medium for delivering instruction to a remote audience, so it is challengeable 
to diversify instructions according to students' characteristics. To do so, we need to 
implement effective online instructional systems based on proven and sound theories from 
science of learning and to have a full imagine of any learner as a way for personalizing, 
monitoring and evaluating online teaching process. 

By reference to the richer literature on relation between personality and learning process, 
experts in e-learning domain suggest that the attractiveness of virtual learning 
environments would be increased by inserting the human personality characteristics in 
these environments. For instance, (Fatahi et al., 2009) propose a new model presented 
according to the learning model based on emotion, personality and the model of virtual 
classmate. In first step, the proposed system identifies learner's personality using the 
Myers-Briggs Type Indicator (MBTI) questionnaire. Thereafter, the virtual teacher and 
classmate express suitable instructional behaviors to improve the learning process 
according to the identified learner's personality model and emotional status. The 
experimental results show the significance of the proposed instructional approach to 
increase learning quality and to satisfy learners. (Abrahamian, Weinberg, Grady, & Stanton, 
2004) show the significant effect of personality-aware human-computer interface on 
learning process. Indeed, the authors design a set of user interfaces which fit personality 
types identified using the MBTI test. Then, they provide a given user interface to 
participants with the matching personality type. They find that users prefer user interfaces 
designed for their own personality type. This finding indicates the positive effect of 
personality-aware user interfaces on learning. (El Bachari et al., 2010) suggest an Adaptive 
e-learning model based on learner's personality. The proposed system uses the MBTI 
psychometric test to recognize learner's personality and suggests a learning style that 
matches his preferences. 
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The previous works have mostly relied on self-report measures to explicitly acquire users' 
personality, which unavoidably demands user efforts. From users' perspective, they are 
sometimes unwilling or unable to provide accurate reports of their own psychological 
attributes or just unwilling to answer the quiz for the sake of saving efforts or protecting 
their privacy. This method of personality measure has a potential inaccuracy because of its 
lack of objectivity and a bias due to cultural influences. To overcome these limitations, we 
are motivated, in this study, to show how to implicitly derive users' personality from their 
behavior data. While personality manifests itself in an abundance of cues, this work focuses 
only on cues from reading and writing behaviors. Specifically, we are interested to 
personality computing based on users' annotation cues. 

The layout of the remainder of this study is as follows. First, we present the credibility issue 
of learner's personality modeling in online learning context. Then, we show reader's 
personality markers in handwritten annotations. Thereafter, we propose a computational 
model used to recognize learners' personality traits through their digital annotations. Next, 
we evaluate the system's performance to measure accurately the Big Five scores of 
learners' traits. Finally, we discuss our results, we draw some conclusions and we suggest 
certain possible directions for future works. 

ISSUE OF MODELING LEARNER'S PERSONALITY IN ONLINE LEARNING CONTEXT 

Although the findings of previous works are fruitful, we believe these researches have left 
certain open issue related to the followed approach to collect required data to model 
learners' personality profiles. In distance learning context using psychometrics standards' 
which are a standards and scientific methods used to measure individuals' mental 
capabilities, behavioral style and personality traits, to determine learners' personality has 
many challenging aspects related to the validity of self-reported data. The crucial aspect to 
consider in user profiling process, is to model a credible student's profile that reflects truly 
learner's characteristics in the online learning environment (Chieu, Luengo, Vadcard, & 
Tonetti, 2010; Gong, Beck, & Heffernan, 2011; Lintean, Rus, & Azevedo, 2012). The contact 
with test-takers using online psychometric tests is indirect, and because of the diminished 
control over the testing situation, there is no way to confirm that they have understood 
instructions and/or items correctly or to provide them with ongoing guidance (Barak, 
1999). This situation may affect the reliability of the test results. Furthermore, the users 
tend usually, to preserve their privacy over web, and they are not ready to reveal their 
personalities information through filling psychometric forms. Consequently, the test- 
takers, either, do not fill the forms or cheat the answer when the motivation to do is obvious 
(Barak, Buchanan, Kraus, Zack, & Strieker, 2004). According to psychology experts, the 
personality tests are designed to be administered under controlled and standardized 
conditions which are not the case of the Web-based assessments tests (Barak et al., 2004). 
As a way to collect a credible data from people, certain psychologists seek to alternative 
measurement instruments that reduce participants' ability to control their responses and 
do not require introspection for the assessment of psychological attributes (Gawronski & 
De Houwer, 2014). 

Several works shed the light on the possibility of personality computing through users' 
observed actions or their captured digital behavioral-residues in different on-line working 
environments. In this scope, there is an increasing interest in understanding human 
perception based on reading and writing behaviors. Many researchers are interested to 
study the ability to profile users' personality from human text production and peculiarities 
of reading behaviors. For instance, (Celli, 2012; Mairesse, Walker, Mehl, & Moore, 2007; 
Wright & Chin, 2014) show the opportunity to derive users' personality from text and 
linguistic cues. Further works suggest extracting personality traits from users' hand writing 
(Fisher, Maredia, Nixon, Williams, & Leet, 2012; Grewal & Prashar, 2012; Prasad, Singh, & 
Sapre, 2010; Rahiman, Varghese, & Kumar, 2013). Other researchers are interested to 
extract users' trait from posts written in online social spaces (Iacobelli, Gill, Nowson, & 
Oberlander, 2011; Sumner, Byers, Boochever, & Park, 2012). (Mezghani, Zayani, Amous, & 
Gargouri, 2012) propose to derive personality from social annotations and (Jackson, 2001; 
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Omheni, Mazhoud, Kalboussi, & HadjKacem, 2014) show the relation between readers' 
personality and their annotation traces made during reading activity. 

We aim by the current work to present new mythology of personality modeling in 
computer-based learning systems. Our goal is to increase the credibility of learner's 
personality profile by computing the required data, implicitly, based on learner's observed 
annotation traces. 

PERSONALITY MARKERS IN ANNOTATIONS 

Annotation is a handwritten practice which bridges between reading and writing (Marshall, 
1998) and constitutes the most prominent habit of reading activity (Lamb, 2007). The 
annotation activity is "basic and often unselfconscious ways in which readers interact with 
texts" (Marshall, 2009, p. 38). Furthermore, the annotation is described as a natural human 
activity that is used in daily life as an integral part of reading activity (O'hara & Sellen, 
1997). Kirwan (2010, p. 5) considers reader's marginalia (annotations) as: the "most direct, 
reactionary response to the text that can feasibly be considered" to study the relation 
between the reader identity and the text. According to (Kirwan, 2010), annotations provide 
the link between reader, text, and meaning and reflect the subjective individuality of the 
annotator's responses to the text. Based on this subjective relationship, the author 
suggests expanding the psychology-based reader theory to include reader's annotation 
practices. 

Every annotator has unique individual patterns in making annotations (Naghsh, 2007). 
According to (Jackson, 2001, p. 5), "if you ask annotators today what systems they use for 
marking their books and where they learned them, they generally tell you that their 
methods are private and idiosyncratic". Hence, the individuality of annotation patterns 
shows that there can be some sort of connection between annotation practices and 
annotator's personality. (Jackson, 2001, p. 87) assumes that "marginalia [annotations] 
express a reader's impulsive and unguarded reactions to a book" and she "consider[s] them 
to be an exceptionally reliable guide to personality". 

In this essay we suggest utilizing digital annotations to compute learner's personality in 
online learning environment. In what follow, we explain which type of personality trait we 
are going to take into account in our study. Then we present our prior work that shown the 
connection relation between learners' personality and their handwritten annotations. 

The Big Five Personality Model 

The big five personality model is the best accepted and most commonly used scientific 
measure of personality that has been extensively researched (Peabody & De Raad, 2002). 
Human personality is well described as five traits were discovered through the study of 
adjectives from natural language that people used to describe themselves. The five traits 
representing the main personality dimensions are: Openness to Experience, 
Conscientiousness, Extraversion, Agreeableness, and Neuroticism. 

Prior Work 

In prior work, we conducted an empirical study to show the implicit relation between the 
reader's annotations and his personality traits (Omheni et al., 2014). We consider a sample 
of 120 volunteers. The subjects selected were recruited with respect to certain criteria. In 
fact, the volunteers' ages are equal or superior to 18 and they have different occupations 
and interests. In our sample we have the two sexes (44 women and 76 men). Furthermore, 
all the participants have the habit to annotate their documents while reading. Each subject 
was instructed to answer a standard Five Factor Model questionnaire (the NEO-IPIP 
Inventory). This step gives us the personality scores based on the Big Five Model for each 
volunteer. To associate personality scores to subjects' annotative activities, we gathered 
annotation practices for each participant and we collected a simple set of statistics about 
his annotative activity (TNAA: Total Number of Annotation Act; ANAA: Average Number of 
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Annotation Act; NGAA: Number of Graphical Annotation Act; NTAA: Number of Textual 
Annotation Act; NRAA: Number of Reference Annotation Act; NCAA: Number of 
Compounding Annotation Act). The set of statistics tends to characterize quantitatively the 
reader's annotation practices. We studied the Pearson correlation between subjects' 
personality scores and each of the features obtained from analyzing their annotative 
activities. We reported the correlation values in table 1. 


Table: 1 

Pearson Correlation Values Between Scores of Annotation Features and Personality Traits 


Variables 

Openness 

Conscientiousness 

Extraversion 

Agreeableness 

Neuroticism 

TNAA 

-.059 

.128 

-.138 

.089 

-.287* 

ANAA 

.003 

.080 

-.210* 

.163 

-.183* 

NGAA 

-.067 

.040 

-.130 

.105 


NTAA 

.001 

.182* 

.040 

.085 

-.211* 

NRAA 

-.075 

.045 

-.122 

.077 

-.207* 

NCAA 

-.059 

.012 

-.147 

.014 

-.219* 


Note. *p<.05 


Conscientiousness is positively related to number of textual annotations. The rest of the 
correlation values are not considerate because of Rvalue > 0.05. But this is not a reason 
to reject definitively the rest of annotation features as a larger sample size may produce 
other significant correlations. Extraversion is negatively correlated with the average 
number of annotation act. Neuroticism is negatively correlated with all the annotation 
features. Here, the sample size is sufficient to procure significant correlations for all the 
considered features. 

Furthermore, we make predictions about subject's personality based on multiple 
annotation features. Our findings show that Neuroticism and Conscientiousness can be 
predicted with reasonable accuracy using the different annotation features, whereas other 
traits are more difficult to be predicted (Table. 2). Based on the values of the coefficient of 
multiple determinations R 2 which measures the strength of the correlation fit and the F- 
test which measures the statistical significance of the collective influence that have the 
annotation features on the personality traits presented in table 2, we show that prediction 
regarding Conscientiousness is reasonably accurate, with R 2 value of 0.12, Fobserved value of 
2.52 which exceeds Fcnticai value and P-value of 0.03 which is lower than a value where P- 
value is the probability of the F-test statistic is larger than the observed F-value. For 
Neuroticism we obtained the model with the best fit, with an R 2 value of 0.14, Fobserved value 
of 3.11 and P-value of 0.01, indicating quite accurate prediction. The model for Extraversion 
has a lower fit and the model for Agreeableness is even less accurate. It seems that 
Openness is the hardest trait to predict using annotation features. 
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Table: 2 

Predicting Personality Traits Using Annotation Features through Multivariate Linear 

Regression 


Personality Trait 

R 2 

F-test 

P-value 

Openness 

.03 

.57 

.76 

Conscientiousness 

.12 

2.52 

.03* 

Extraversion 

.07 

1.32 

.25 

Agreeableness 

.05 

1.03 

.41 

Neuroticism 

.14 

3.11 

.01* 


Note. *p<.05 


EXTRACTION OF LEARNER'S PERSONALITY TRAITS FROM DIGITAL ANNOTATIONS 

Based on what previously cited, it is plain that reader's annotation is really an expression 
of his personality traits. Indeed, we show very plainly that the considered annotation 
features in our study may appear insignificant in them-selves, but, they are nevertheless 
all very significant as indications of the annotator's personality traits. 

Recent researches endeavor to replace the "pen-and-paper" paradigm for the annotation 
needs by employing the technology of free form digital ink annotations which add the 
flexibility and natural expressiveness of the traditional handwriting method to the digital 
annotation process. Such tools enable readers to annotate their digital documents similarly 
to "pen-and-paper" case. These tools refer to user studies examining the paper-based 
annotation that analyze readers' annotation behavior during the learning process (Nunes, 
Kawase, Dietze, de Campos, & Nejdl, 2012; Steimle, Brdiczka, & Miihlhauser, 2009). Such 
works provide several insights to fully comprehend the desired annotation features needed 
on the digital support. Hence, the digital annotation context becomes very similar to the 
context of "pen-and-paper". Due to the proximal similarity among these two contexts, we 
are motivated to apply our previous findings in the digital context to automatically predict 
users personality traits based on their annotations. 

The proposed system called "i-Read" is an online reading environment where learners can 
upload their reading materials, practice their habit of annotation and share their annotated 
documents with others. Figure 1 illustrates interactions between the various modules of "i- 
Read" system along with the flow of data. The system's architecture consists of user 
annotation interface, the annotation analyzer module, the profile constructor module and 
three databases with two servers. To avoid destroying the original version of reading 
materials, our system uses an independent annotation database, which differs from the 
documents database, to store annotations' parameters and contexts from learners. The 
annotation interface provides several powerful annotation functionalities, such as 
scribbling, highlighting, underlining, commenting, as a way to engage users actively with 
their reading contents. 
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i-Read online environment 


0 



Learner 


Document Server 



Documents repository 



Annotations repository 



Profiles repository 



Profile Server 


Figure: 1 

The "i-Read" Architecture System 
The Annotation Analyzer Module 

This module is used to observe reader's annotations yielded during a reading session and 
to compute certain parameters related to the total number of annotations, average number 
of annotations (number of annotation per one page of document reading), number of 
graphical annotations, number of referential annotations, number of textual annotations 
and number of composed annotations. The Annotation Analyzer Module tracks annotations 
of the connected user and stored them in a relational database. In our concept, a user 
annotation trace is an act that affects an element of the document reading. The annotations 
are tracked and stored with their parameters which are the following: 

1. Target: contains the values of coordinate points that define the annotated 
element in the logical structure of document reading, 

2. Body: the content of the annotation trace 

3. Sign: we classify annotations in three general categories. This categorization 
is based on how annotations can appear and be represented: (a) textual 
annotation expressed by a piece of text added to the annotated document; 

(b) graphic annotation expressed by a graphic mark added to a document; 

(c) reference annotation expressed by a link between two texts or two 
textual pieces in the same document. 

Agosti & Ferro (2003) called the three categories of visual signs as the basic ways to 
represent annotations. Furthermore, they define the term sign as a formation of a meaning 
that can be combined together to express more complex signs of annotation. 

In our work, we consider the annotation sign parameter as the main characteristic which 
constitutes the cornerstone to study quantitatively the digital annotation activity. In fact 
we compute certain features with reference to the visual sign of annotation traces (graphic, 
text, reference, composed). Technically, to implement the system annotation tool, we refer 
to Annotator.js library. The annotation model adopted in our work follows a simple JSON 
format with three fields: 
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{ 

"anchor "some text to anchor to ", 

"text "the annotation text ", 

"type "flag " 

} 

Where "anchor" (target) is the specifications used to position the annotation on the reading 
material. Technically, we have used the anchoring strategy inherited from the Annotator 
project, which anchors annotations to their targets by saving exact locations in the form of 
XPath range descriptions to the involved DOM elements and the string offsets inside them. 
When the anchor needs to be located again, the DOM elements are found by using the same 
XPath expressions. Regarding the other annotation's parameters, "text" is the body of the 
annotation to show, and "type" (sign) is the kind of annotation. 

The Profile Constructor Module 

The profile constructor module is used to predict readers' personality scores through their 
observed annotations. To compute user's traits we utilize the multivariate linear regression 
algorithm. The following equation represents the mathematical format of the collective 
influence of the considered annotations' features on one single personality traits. 

Y = bo + biXi + b 2 X 2 + b 3 X 3 + b 4 X 4 + bsXs + b 6 X 6 

Y is the predicted or expected value of the dependent variable representing the score of 
the focused user's personality trait. Xi through Xo are the distinct independent or predictor 
variables representing the different annotation features considered in our study, bo is the 
value of Y when all of the independent variables (Ai through Xo) are equal to zero, bi 
through bo are the estimated regression coefficients. Based on this mean function, we can 
determine the expected annotator's personality trait as long as we know certain 
peculiarities characterizing quantitatively his annotation practices. We cite in table 3 the 
different estimated regression coefficients used to predict scores of reader's traits given 
the values of the different considered features (x variables). 

Table: 3 

The Regression Coefficients Used to Predict the Score of Reader's Traits 


Independent Variables 

Conscientiousness 

Neuroticism 

Intercept (Ad) 

21.82 

70.06 

Number of Graphical Annotations (AO 

.66 

.18 

Number of Reference Annotations (A 2 ) 

-.02 

-.13 

Average Number of Annotations (Ab) 

.14 

0 

Total Number of Annotations (b 4 ) 

-.81 

-.38 

Number of Textual Annotations (AO 

.32 

-.06 

Number of Compounding Annotations (b 6 ) 

0 

0 


System Operation Procedure 

Based on the system architecture (Fig.l), the functional scenario of "i-Read" system is 
described and summarized as follows. First of all, the learner should connect to "i-Read' 
environment to upload his reading document. In second step, the system saves the 
document in the documents repository. Thirdly, the learner can start reading and 
annotating his document. Fourthly, the system saves learner's annotations in the 
Annotations repository. In fifth step, the annotation analyzer module captures learner's 
annotations and extracts certain quantitative features. Sixthly, the annotation analyzer 
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module sends the computed information to the profile constructor module to build learner's 
personality profile. Seventhly, the profile constructor module considers the received 
information as an input data to the multivariate linear regression algorithm used to 
estimate scores of learner's traits. Finally, the system saves the modeled user's profile in 
the Profiles repository. 

EVALUATION OF "I-READ" SYSTEM'S PERFORMANCE 

In this section, we are interested to check the performance of our system for personality 
recognition compared to the Neo-IPIP inventory which is the most scientifically based test 
of personality traits, and is generally accepted worldwide as one of the more highly 
regarded, and accurate, personality questionnaires. 

Participants 

We recruited 100 volunteers (35 women and 65 men) aged between 22 and 50 years. Most 
of the participants have the professorship degree in scientific or literary disciplines. All the 
invited people have participated in our prior experimentation. We have the decision to re¬ 
invite the same people because they have the required criteria to participate in present 
experimentation. Indeed, they are academic people who have the habit to annotate 
documents while reading. The majority of the selected participants are graduates. 
Generally, this category of people is serious and motivated to make annotations during 
their reading activities. Furthermore, they are good practitioners of annotations and 
conscious of its efficiency in academic achievement and learning performance. 

Procedure 

We instructed the participants to upload their textual materials on the "i-Read" 
environment and to use the system to achieve their reading and annotation activities 
(Fig.2). The volunteers are free to select their reading contents that interest them and the 
text's written language (English, Arabic or French) all depends to their linguistic skill. The 
sample members did not differ on their reading comprehension abilities. The majority of 
participants indicated that they had prior knowledge in the topic of their reading materials. 
The selected documents aren't hard, so they didn't need much cognitive effort from readers' 
side. We consider all the previous conditions because we are very careful to the 
comfortability of participants during their reading activities. These conditions may 
guarantee their spontaneous and natural reactions. In the second step, we instructed 
participators to answer the standard Five Factor Model questionnaire (NEO-IPI P 
Inventory) to compute scores of their personality traits. In third step, we are interested to 
evaluate system's performance to compute accurately learner's scores of 
conscientiousness and neuroticism traits compared to the values determined using the 
NEO-IPIP Inventory. We applied the Pearson Product Moment Correlation to measure the 
linear correlation between the traits scores obtained through the two different systems. 
We also measure the root-mean-square error (RMSE), which are the root mean squared 
differences between predicted values (scores measured with i-Read system) and observed 
values (scores measured with Neo-ipip inventory). 


54 


iReadE 


Home 


Library 


Recommondations 

□ 

Links 

0 

Messages 

<P 

Fnends □ 

* 

My groups Q 



Pic«i gravid* i 



Add a new book + 




Book name lorem ipsum 


r 

-t 

O 

□ 

D 

I # 


< 3 . 

Q. 

& 

□ 


22 


The Importance of Keywords 


The Importance of 
Keywords 

When it comes to understanding language, computers are much 
more literal than we humans. We can see a title like “How to Rock 
Your Resum e,” and immediately understand that “rock" is slang for 
5jmprove7}ind “resume" (even without accents) means “CV" rather 
than “start again." Computers would have a harder time parsing 
that string of words and grouping an article with such a title with 
other r6sum6 writing articles in its index. 

Since {nost) iumans write for other humans, it doesn’t naturally 
occur to us to make parts of our writing more literal to help 
search engines do theirtamEven small changes can make a big 
difference. “How to Rock Your Resume Writing” still contains 
a figurative use of "rock,” but it also contains the term “resume 




Figure: 2 

Annotated Document on "i-Read" online Environment 


RESULTS and DISCUSSION 

We report the statistical coefficients values in table 4 and 5 for the conscientiousness 
and neuroticism traits respectively. Given that correlations are significant (p < 0.05) for 
both consciousness and neuroticism traits and the lower values of RMSE and Mean, we 
show the regression models for the considered personality traits are well-fitting and the 
predicted values close to the observed data values which means that there is no significant 
difference between the scores of user's personality traits computed using the "i-Read' 
system and those measured using the Neo-IPIP inventory. 

Table: 4 

Linear Correlation Coefficients of the Conscientiousness Scores Measured With Two 

Different Systems 


Scores measured with 

Mean 

RMSE 

P-value 

"i-Read" system 
Neo-IPIP inventory 

.02 

o 

■ H 

.03* 


Note. *p<.05 


Table: 5 

Linear Correlation Coefficients of the Neuroticism Scores Measured With Two Different 

Systems 


Scores measured with 

Mean 

RMSE 

P-value 

"i-Read" system 
Neo-IPIP inventory 

.03 

.10 

.01* 


Note. *p<.05 


Several works interested to design personality-based online learning systems utilize 
classical methods to recognize learners' personalities which tend to focus on 
questionnaires. Such works enter their participants into a cash prize draw to externally 
motivate them toward the experimental task (Al-Dujaily et al., 2013; Kim et al., 2013). 
Without such external motivational acts, learners are not ready to answer a range of 40 or 
more questions about their personality information. Usually, learners prefer to preserve 
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their privacy and refuse communicate their personal information with third party. 
Personality recognition based on learners' annotations is not presented here as a 
replacement for psychometric tests, but rather as additional information that may help 
combat some of the difficulties encountered with questionnaires. Possibly the biggest 
advantage is that personality traits measurement through annotation traces can be taken 
in parallel with the interaction rather than wearying the learner to answer a long form or 
too many questions. 

On the other hand, based on our findings, we show the neuroticism trait is negatively 
correlated to the different annotation features considered in our study. This result clearly 
indicates that learners with high level of emotional stability are more productive of 
annotation traces which reflect their deep reading of textual material. Thus, those who 
have low score of neuroticism are more stable and they have the ability to focus more on 
their current activities and they can deal with reading materials qualified with high level of 
complexity. Regarding the consciousness trait, we show this trait is correlated positively to 
annotation features. This evidence reflects that conscientious learners produce more 
annotation traces during their reading. We may interpret the case that learners who have 
high degree of conscientiousness choose to read their reading materials deeply. 

Based on previous interpretations, we believe that learners with high degree of 
consciousness and high level of emotional stability are more able to deal with hard textual 
materials through using annotation skill, knowing that the process of annotation is viewed 
as learning strategy used to improve reading comprehension and favors deeper processing 
and understanding of text (Brahier, 2006; Brown, 2007; Huang, 2014; Porter-O'Donnell, 
2004). For those who have low level of consciousness and high level of anxiety should be 
treated carefully to enhance their reading comprehension performance. These evidences 
may be viewed as guide to design personality-based learning system of online reading 
classes. Actually, many learning systems offer annotation functionalities to their users to 
increase their reading performance (C.-M. Chen et al., 2012, 2014; Yueh et al., 2012). Such 
works show the efficiency of annotation tools to enhance users' learning experience. We 
think that our work is step forward for these works to use annotation traces as indicator of 
learners' personality traits that reflects their reading performance level. This information 
may be helpful to assist learners having difficulties in reading comprehension. Finally, 
although our results are promising and constitute a new tendency in computing learners' 
personality traits based on their behavioral residues of reading and writing activities in 
online learning environment, some limitations need further consideration. The most 
important issue is the sample size as we expect more significant results around the relation 
between annotations and readers' traits (agreeability, extraversion and openness) with a 
larger sample. On the other hand, we limited our study to graduate students with 
experience in annotation. This point can be viewed as a limitation of our study. But, right 
now, we try applying our findings to design adaptive personality-based learning strategies 
to help students enhancing their reading performance and to assist them during their 
learning experience. In this future work, we are interested to normal students who may 
have or not experience in annotation. Furthermore, our study is based on linear correlation 
model, but digital annotations and personality may not be linearly correlated. This 
consideration may be viewed as limitation of current work. We expect trying advanced non¬ 
linear models, or polynomial regression in future works. Also our research can be extended 
to study the influence of readers' demographic characteristics (gender, age...) and further 
factors which may, likely, influence annotation behavior such as familiarity with annotation 
tools and interest in the content topic. 
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CONCLUSION 


This study investigates the possibility of personality recognition based on digital 
annotations. This is a new tendency in personality-computing research area and a step 
forward for indirectly assessing learners' personality in online learning environment. The 
relation between learners' personality traits and their annotation activities may reflect 
their reading performance level, which is helpful to assist students who have difficulties in 
reading comprehension. To overcome shortcomings of reading online, we try to design a 
collaborative learning system which enables students to upload, annotate and share their 
personal reading experiences. This strategy has the potential to facilitate understanding of 
reading texts and helps to develop a reader into a writer and promote collaborative 
learning. We suggest classified learners, according to their scores of neuroticism and 
consciousness traits, to good reader, ordinary reader, and poor reader. Those suffering of 
reading comprehension will receive the annotations of skilled readers. In "i-Read" reading 
environment there is no instructors, just the students teach each other through sharing 
their learning experiences and knowledge. In future paper we'll give more details about 
this work and the conducted experiments to show the efficiency of the proposed approach 
to support learners with low online reading abilities. 
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